Mutual Information as a Stereo Correspondence Measure
نویسنده
چکیده
Traditional stereo systems often falter over changes in lighting between their two views. Unfortunately, such changes often occur when using stereo with a wide baseline or between images from different spectra. In this paper, we propose a new dense stereo correspondence similarity metric, mutual information, which has the potential to overcome such adverse conditions. We explore the strengths and weaknesses of this metric, both quantitatively and qualitatively, under a variety of conditions. Throughout the exploration, we compare mutual information to a more traditional cross-correlation stereo system. We show that mutual information performs under conditions in which traditional dense stereo fails. Comments University of Pennsylvania Department of Computer and Information Science Technical Report No. MSCIS-00-20. This technical report is available at ScholarlyCommons: http://repository.upenn.edu/cis_reports/113 "!# !# %$& ' !# "() *+!, -.!/ !# " ! 0+132547681 9;: <>= ?5@ 0BADC E"FHG#?5IJ2>6K?ML82>6N9 O = PRQ5136NS8PRLT9U25VWF,13= ="SN9X@RQM?5= PY? : Z[?5PR@]\^<>13<>= ?5@`_ <>68?5S8acbed3PRS3bef aJ13= =cbe13g"f
منابع مشابه
Stereo Vision Correspondence Selection using Mutual Information and the Development of a Parametric Framework
This paper addresses the problem of correspondence selection in stereo vision using the mutual information (MI) measure. MI is an information theoretic topic that has recently seen a prolific expansion in the computer vision and medical imaging field. Two main issues are considered in this paper. Firstly, a new stereo matching algorithm is presented that uses a histogram-based formulation of mu...
متن کاملUsing Mutual Information in a Wavelet Based Hierarchical Approach to Solve Stereo Correspondence Problem
In this work, we propose a wavelet-based hierarchical approach using mutual information (MI) to solve the correspondence problem in stereo vision. The correspondence problem involves identifying corresponding pixels between images of a given stereo pair. This results in a disparity map which is required to extract depth information of the relevant scene. Until recently, mostly correlation-based...
متن کاملLocal self-similarity-based registration of human ROIs in pairs of stereo thermal-visible videos
For several years, mutual information (MI) has been the classic multimodal similarity measure. The robustness of MI is closely restricted by the choice of MI window sizes. For unsupervised human monitoring applications, obtaining appropriate MI window sizes for computing MI in videos with multiple people in different sizes and different levels of occlusion is problematic. In this work, we apply...
متن کاملEvaluation of Similarity Measures for Template Matching
Image matching is a critical process in various photogrammetry, computer vision and remote sensing applications such as image registration, 3D model reconstruction, change detection, image fusion, pattern recognition, autonomous navigation, and digital elevation model (DEM) generation and orientation. The primary goal of the image matching process is to establish the correspondence between two ...
متن کاملRobust stereo matching based on probabilistic Laplacian propagation with weighted mutual information
Conventional stereo matching methods provide the unsatisfactory results for stereo pairs under uncontrolled environments such as illumination distortions and camera device changes. A majority of efforts to address this problem has devoted to develop robust cost function. However, the stereo matching results by cost function cannot be liberated from a false correspondence when radiometric distor...
متن کامل